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ABSTRACT 


An attempt was made to determine if one of the basic piloting 
skills was lost during prolonged periods of nonflying. "Current" 
and "stagnant" groups of jet Naval aviators were tasked with responding 
to a sequence of sixty slides of an aircraft attitude indicator. The 
Subjects’ response times were measured. The slides depicted twelve 
different aircraft attitudes, No significant difference was found 
between groups but a definite learning trend was established. The 
subjects were reassigned into "more experienced" and "less experienced" 


groups. The more experienced group performed significantly better. 
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£1. BACKGROUND AND PURPOSE 


A 1971 questionaire study by Schrady and Hanley determined that 
pilots at the Naval Postgraduate School (NPS) thought that four flight 
hours per month were insufficient to maintain mission skills and 
personal confidence. Complete elimination of flying by students at 
NPS could be expected to jeopardize the functioning of the aviators 
at a later time, both as aviators and as flight leaders. 

In December, 1971, the U; S. Congress ceased funding for profi- 
ciency flying by military flight personnel undergoing courses if 
instruction of six weeks or longer. Prior to this decision, flight 
personnel were required to fly four hours monthly to maintain a minimum 
flight proficiency. Most aviators believed that four hours were 
barely adequate. Some educational programs take anywhere from fourteen 
to thirty-six months. After prolonged periods of no flying such as 
this, most aviators believe that it will require an additional two to 
four weeks of refresher flight and ground school training before 
commencing standard Combat Replacement Air Wing training in their 
a ge OD assignment. 


One measure of proficiency is a pilot's ability to recover an 


eens a i TS —— A py, on ee = 


aircraft from an "unusual attitude"; that is, one not consciously 
established by the pilot. i is not ategall uncommon for the’ pilot 


to be distracted briefly from his flight instruments to make radio 
frequency changes, copy clearances, etc., and upon rescanning his 
flight instruments, find that the aircraft has entered an unusual 


acticude. 





The primary reference instrument in a non-visual flight condition 
is the verticle gyro indicator (VGI). This device is a sphere, sta~ 
bilized gyroscopically, that can be interpreted by the pilot to 
determine the aircraft's pitch and roll attitudes. 

Milton (1947) found that the difference between comprehension and 
recovery time in instrument flying averages 1.7 seconds longer than 
when flying with external visual references. Add to this any sort of 
initial misinterpretation which must be recognized and recorrFrected, 
it is easy to see how a pilot can respond incorrectly or not at all to 
a situation that requires prompt, cofrect action. 

It is apparent that a key factor in safe recovery from.an unusual 
attitude is correct |VCI interpretation and, equally important, proper 

2 eee aa! —_" 
initial input to the aircraft's control system to affect a recovery. 
The purpose of this experiment was to investigate the elapsed time 


required by pilots between awareness of the VGI position and the cor- 
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II. EXPERIMENTAL PROCEDURES 


A. APPARATUS 

A Monsanto model 100B electronic timer was used to measure the 
time between stimulus onset to response input. A Lafayette Data Sys- 
tems Random Access model 12910 was used to select slides and time the 
tachistoscopic shutter mounted on a Kodak Ektagraphic RA960 projector. 
The flash terminals on the shutter were used to close the circuit 
initiating the timer. 

A control stick, similar in shape and feel to that of a typical 
jet aircraft, was fitted with microswitches to detect approximately 
three inches of displacement from neutral in the four directions of 
travel possible (back, forward, left aa right control inputs). Each 
£ these microswitches was connected in series with a toggle switch 
on a selection box so that only a correct control response would 
complete the circuit to stop the timer operation. 

A Hudson Photographic Industries Caritel rear projector cabinet 
was used with the projector mounted to project an image in front of 
the pilot at approximately normal instrument panel size and distance. 

A control tape for the random access timer was punched, utilizing 
a Control Data Corporation 160 computer. This control tape was ran- 
domized within sth block of slides. 

All experimental trials were conducted at the Naval Postgraduate 


School Man-Machine Systems Design Laboratory, Monterey, California. 


Bee SUBJECTS 
Twenty-two volunteer male military officers assigned to the Naval 


Postgraduate School (NPS) and the the Naval Aviation Safety School 





were tested. All the subjects were experienced Naval Aviators from 
the U. S. Navy, enrolled as students at NPS or at the Safety School. 
The median number of years of designation as an aviator was 6 years, 
ranging from 4 to 23 years Their median total flight time was 1700 
hours, ranging from 750 to 6,000 hours. All the subjects were jet 
(fighter and attack) pilots who encounter all descriptions of flight 
attitudes as a normal consequence of their missions. 

To determine if prolonged periods of nonflying reduced proficiency 
in unusual attitude recovery, 11 of the subjects were chosen that had 
been at NPS since proficiency flying was halted and 11 were chosen 
that were in their first quarter at NPS or at Safety Schools; i.e., 
they had all flown within a 24 to 60 day period. It was hypothesized 
that there should be a significant difference in response times be- 


tween the two groups. 


Gye SLIDES 

Twelve slides were used in the test. The attitudes depicted were 
a representative sample of attitudes that can be attained. The 
attitudes were divided evenly between upright and inverted; six up- 
right and six inverted Five were in a nose high, four in a nose 


low, and three in a nose level attitude. 





Slide # 


Attitude Depicted 


Correction 


Required 


i Nose level, upright, right wing down Left 

2 Climb, inverted, wings level | Back 

3 Dive, upright, wings level Back 

4 Nose level, inverted, left wing down Right 

5 Climb, upright, right wing down Forward 

6 Nose level, inverted, right wing down Left 
7 Dive, upright, right wing down Left 

8 Dive, upright, left wing down Right 

9 Climb, inverted, right wing down Back 
10 Climb, inverted, left wing down Back 
ILA Climb. upright, wings level Forward 
ag! Dive, inverted, left wing down Right 


See Appendix G for pictures of Slide #9 and a picture of the atti- 


tude indicator in normal flight. 


D. METHOD 


Prior to the experiment, each subject was given a brief explanation 
of the equipment and the purpose of the experiment. The experimenter 
then read the Friseruc eneNe the subject (Appendix D). 

In order to determine what each subject's reaction time in each 
direction of control stick movement was, he was asked to move the 
stick five times for each of the four directions of movement. An aver- 
age basic movement time for each direction was then computed. 

After the twenty basic movement time slides, the subject was shown 
twelve VGI slides in five trial sets of twelve, randomized within 


each block (Appendix E), Each slide was projected for eight seconds 
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with nine seconds between slides. This nine second period was used by 
the experimenter to record the time for the last slide, select the cor- 
rect response (L, R, U, D) toggle switch for the next slide, and reset 
the timer to zero. An eight second response time was recorded if no 
correct response was given. 

The average movement time for the correct response direction was 
subtracted from each VGI response. This enabled only his decision 


time (Decision + Movement = Response) to be utilized for the analysis. 


it 





III, RESULTS AND DISCUSSION 


Table I gives a summary of the results of the experiment, 
TABLE I 


Mean Response Times by Groups, Slides, and Trials and 


Over All Groups, Slides, and Trials: 





Over 
Ail 
Groups Slides Trials Trials 
1 2 3 4 5 
1 1.45 0.69 0.99 0.64 i oe 0.86 
z 3537 jee Bye 1.67 1.09 0.83 1.86 
3 1.09 0.80 0.72 0.58 0.57 0.75 
4 2623 ie 3 0.92 0.84 0.99 26 
5 8.04 LES ae 1.14 IPs s: 1 a45 0.93 
STAGNANT 6 2.98 1 es I 02.57 TZ 6 0.95 1.38 
7 22 1365 1.19 0.96 0.94 1.49 
8 3.65 1.81 0267 1.49 oe 1.84 
9 U Arsh: 1.96 eo 0.95 i206 1.40 
10 6.28 Dos Ie ys 1.61 1.19 2.69 
11 1.08 O2SZ 0.69 0.84 0.71 0.83 
12 Zeal] Ale ee 1.27 2.36 2.05 
Over All 2.69 Je FA, 1.05 | ea Ea Lk 1.53 
Slides 
i iee29 0.69 0.56 Oe52 0.44 0.70 
2 2.85 1.60 J 0.86 o/s 1.43 
3 0.90 0.98 ares, 0.65 Oa J) 0.78 
4 2.10 1.69 0.86 0.95 O27 127 
5 1. 35 5S 1.18 i 20 0.99 1.36 
CURRENT 6 2.18 1.08 Ov 7k 1.04 0.81 1.29 
; y. 25 2.44 0.96 0.79 1.00 1.29 
8 a 2429 6 2 O60 76 1% 33 1 ss 
9 2.39 La? G 0.93 37 od 1.56 
10 6.9/7 ial 1.69 ie 37 0.91 Ze 
11 107 0.87 0.49 0.76 0.62 Ond7 
To 2.46 i igs was 2.19 roo 1. o2 
Over All 2uoD Paget) 0.94 1.12 0.91 13356 
Slides. 
Over All Groups Zee 1.59 0.99 1.12 1.00 1. 45 


and Slides 


Stagnant vs Current 





An analysis of variance (Table II) of the data comparing "current" 
versus "stagnant" mronroeindt cates that there was no significant dif- 
ference in responses of the two groups. There was a strong difference 
among the twelve slides and the five sets of trials and a high degree 


Siteinreraction betweenecrtials) and gsiides. 


Table II 


ANALYSIS OF VARIANCE COMPARING CURRENT AND STAGNANT GROUPS BY SLIDES 
AND TRIALS 


SOURCE df SUM OF SQUARES MEAN SQUARE F P 
TOTAL 1,319 2,947.389 --- — ao 
BETWEEN SUBJECTS 21 159.112 — — ~—~ 
GROUPS 1 9.247 9.247 1.234 ns. 
ERROR BETWEEN 20 149.866 7.493 --- --- 
WITHIN SUBJECTS 1,298 2,788.279 --- a --- 
SLIDES 11 342.156 31.105 17.777. <.001 
TRIALS 4 445.210 111.317 94.010 <.001 
GROUPS X SLIDES 11 ORG i, LOZ OS OMEN ace 
GROUPS X TRIALS 4 4.547 1.137 .960 nas. 
SLIDES X TRIALS 44 365.562 8.308 6.762 <.001 
SLIDES X TRIALS 44 © 58.094 1.320 1.025 nes. 
_X GROUPS 
ERROR 1 290 384.556 tye ee a 
ERROR 2 80 94.928 1.184 --- = 
ERROR 3 880 1,081.192 1.229 --- --- 
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The slide difference reflected variations in the degree of inter- 
pretative difficulty for arches tides Table III shows the average 
response time over all subjects for each trial. 

TABLE III 


Mean Response Times by Slides and Trials and 
Over All Slides and Trials 


Over 
All 
Slides Trials 
1 2 3 4 5 
1 | ree! 0.69 0.7/7 0.56 0.98 OA ie 
2 3. i 1.97 LOG 0.97 0.78 1.65 
3 0.99 0.89 ORES: 0.61 0.57 0.76 
4 2.16 Wes) 9) 0.89 0.90 0.88 Lad 
5 2p a8 1.90 1.16 1.49 S22 1.65 
6 2.88 1.10 0.64 LS 0.88 oo 
7 1.98 2.04 1.07 0.87 0.97 1.39 
§ 3207 Ay 0.66 662 Leos 1.68 
9 2s 1.86 0.92 1 iol 1.48 
10 6.02 oye. ol 1.49 OS 6% 
11 1.07 0.84 0.59 0.80 0.66 0.80 
12 2 OG 2.29 1.44 1.373 erode: 1.94 
Over All Ze OL 1.59 0.99 Pele? JES Oe Ee 
Slides 


A puncan multiple range test was performed, Table IV, to attempt 
to determine a pattern of difficulty among the slide presentations. 
The results were rather inconclusive. The three easiest slides (3, l, 
11) were all of Hogi: attitudes with only one correction needed (up, 
left, down) to place the aircraft in normal flight. 

Slides 4, 6. 7, 9, 2, 5, and 8 comprised a middle group that con- 
tained all possible combinations of attitudes and corrections. If 
the first trial of slide 10 were disregarded it could be grouped with 
slides 9, 2, 5, 8, and 12 as being the hardest. There seemed to be 
no common denominator among this group except there was no slide re- 


quiring a left correction. The fact that the three slides requiring a 


left correction were not in this group may reflect a left turn 
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syndrome, An automatic left turn response may have been instilled in 
these aviators from the fact that landing patterns at most airfields 
and all aircraft carriers require left turns as do most practice 
bombing target patterns. The fact that all pilots tested were fighter 
and attack carrier pilots, each having flown literally hundreds of 
simulated carrier landings and practice bomb runs may explain why left 


corrections were seemingly easier. 
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The lack of significant difference in performance between the two 
groups was surprising. It may relfect one of two things: 

1. A 14 month period of nonflying is not as serious a detriment as 
had been hypothesized, or 

2. This particular skill is lost rapidly; i.e., the first 4 weeks 
of nonflying is the period where most of the ability to recognize VGI 
indications is lost. 

The high degree of interaction. between trials and slides may be 
explained by examination of figures 1, 2, and 3. It will be noted that 
there are some slides with steep learning curves (slide 2) and some with 
shallow learning curves (slide 3). The very high mean value for the 
first trial of slide 10 may be because slide 10 happened to be the third 
slide in the sequence and it was the first "difficult" attitude pre- 
sented. Almost all subjects were visibly surprised to see an attitude 
of this nature so early in the trial sequence. 18 of the 22 subjects 
did not respond correctly to this slide on the first trial within the 
8 second time period. Subsequent trials of this slide yielded results 


similar to other difficult slides. 


Secs. 


Mean Response 
Time by Trials, 2 
Slide 2. 

> 


1 2 S 4 5 
Trial # 


Figure ] 





Secs 





2 
Mean response time 
1 
by trials 
Slide 3 
1 : 
Trial 4 
Figure 2 
Secs. 
7 
6 
Mean response time 
by trials 5 
Slide 10 
sae 
Z 
1 
1 2 3 4 5 
Tria lei 
Figure 3 


It was noted that two other groups could be formed from these 
same subjects with the criterion for group membership being total 
flight time. This was done forming one group composed of aviators 
having less than 1,700 hours and the other group having more than 


1,700 total flight hours. 
18 





Table V shows the data from the new grouping. 


TABLE V 


Mean Response Times by Groups, Slides, and Trials and 
Over All Groups, Slides, and Trials; More Experienced vs Less Experienced 





Groups Slides Trials Over All Trials 
1 2 3 4 5 
1 ino OmeO.67 Woes? '0.596° 10.42 0575 
2 2eogee e350 Puno) O.766-0.62 P30: 
6 0,835) 0284.02.67 90.54 0.48 0.67 
4 1.86 22A4e 1.02 0.92 0.98 iy 30 
eres 5 aoe tb WO SO. 1 3ie0 . 93 We, 27 
Experienced 6 Pails SOR Le 3) Bee) 1, 39 
ii i eee. 23 ee Ole 0570 0.95 1, 22 
8 Deo 1.660 POVS2ael O66 1720 ae, 
9 Looe 560 10.76 eee 1533 P30 
10 Gece el, 3em 1.5) 1.4080.95 2 42 
11 1 ieeO. 7 SeeeOeeaeoeoo 0.54 0.69 
2 1,701.77 1 oe bh. S6 81516 eae: 
Over eddie? . Ziel Ove 0.67 1,06 9.5/7 1.28 
Slides 
1 Fi Gimmes 1 wero 0.50. 70.53 OFoZ 
2 325m Oodle OG yl. 1950.94 1.99 
3 oye. 94° 80,62 0.69 70.66 0.86 
4 2.400 1826 70.76 0.86 0.78 235 
Peas 5 So, LOM. o6 oe 1.671.447 2205 
6 8, O03mO.o 7 aro. 07.92 0.69 125 
: 7 2.) 5 COU ela) 1405 80.99 P56 
pec 5 S76) 0680) 1.59 BEA] 1.89 
9 DetOme. SG 0 bal Ood 312350 1.66 
10 OF 300) 3,165 1:66 81.538 912587 2299 
LL 1 O26 0294— 0.8) 0.92 0.80 0.90 
‘ig Bi Gee iS Vielen > Ine OD Zas0 
Cre 2 omen, | I) 2 Or 5 ae 3 es6 1: 
Slides 
Over All Groups. 2.521459 0.90) 1.12. 1.00 dote5 


and Slides — 
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An analysis of variance (Table VI) of the data from the new grouping 
showed that there was a significant difference in performance, with 
the pilots having more flight hours performing better. Similar results 
to Table I were obtained, reassuringly, about slide and trial differe- 


neces and interactions. 


TABLE VI 
Analysis of Variance Comparing Groups of Less Than 1700 Hours and Greater 


Than 1700 Hours by Slides and Trials 


SUM OF MEAN 

SOURCE df SQUARES SQUARES f p 
TOTAL 1319 2,947.389 --- --- --- 
BETWEEN SLIDES 21 159.112 a a -—- 
GROUPS i 35.384 35.384 5.719 025 
ERROR BETWEEN 20 123.728 6.186 --- --- 
WITHIN SUBJECTS 1298  2,788.277 === --- -—- 
SLIDES i! 342.156 31.105 18.461 <.001 
TRIALS 4 445.269 111.317 101.408 <.001 
GROUPS X SLIDES LIL 26.046 2.368 14-05 nest 
GROUPS X TRIALS 4 11.457 2.864 2.609 N.S. 
SLIDES X TRIALS ry. 365.562 8.308  .6.742 ¢.001 
SLIDES X TRIALS 44 54.827 1.246 1.011 nes. 
X GROUPS 
ERROR 1 220 370.683 1.683 --- — 
ERROR 2 80 87.818 1.098 a a 
ERROR 3 880 1,084.459 1.232  --~ --- 
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These results suggest that, to a certain extent, experience is a 
greater factor in this particular flying skill than currency. 

A study by Fitts and Jones (1947) determined that the VGI contri- 
buted to pilot errors in two categories, reversal errors and errors 
due to illusions. Reversal errors are the result of misinterpretation 
of the VGI, thereby making a control movement that aggravates rather 
than corrects an undesirable condition. A statement typical of those 
recorded by Fitts and Jones was: 

"T glanced away from the instruments.... Upon glancing back 

at the artificial horizon, I was confused as to the direction of 

turn shown by the little pointer which indicates degree of bank. 

Upon beginning to roll out, I used exactly opposite aileron control 

from what I should...." 

The first phrase of that statement is crucial. A pilot who is able 
to continually scan his VGI is not apt to misinterpret it. As stated 
earlier, however, a pilot does not usually have that luxury. The degree 
of discontinuity in this experiment did exaggerate the problem because a 
good instrument pilot can regulate his scan to providebits of attitude 
information regularly to enable him to interpret the situation in a 


continuous manner. 


rans 





IV. SUMMARY 


An attempt was made to determine if a prolonged period of no 
flying is detrimental to one of the basic piloting skills: the abil- 
ity to recover an aircraft from an unusual attitude. Current and 
stagnant groups of jet Naval Aviators were tasked with responding to a 
sequence of sixty slides of an aircraft attitude indicator. The 
slides depicted twelve different aircraft attitudes. No significant 
difference was found between groups. The subjects were reassigned into 
more experienced and less experienced groups. The more experienced 
group performed significantly better. 

The author believes that follow-on work in this area is definitely 
warranted. It is believed that comparisons made between a stagnant group 
composed as this one and a current group composed of aviators that had 
flown within a day or two of testing would yield different results; 
i.e., there would be a significant difference in performance. 

The experiment does suggest that, to a certain extent, experience 
is a greater factor in this phase of flying skill than currency. It 
is recommended that strong consideration be given prior to assigning 
pilots with low flight hours to billets with prolonged periods of no 


Flying. 
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APPENDIX A 


SUBJECTS TESTED 


SUBJECT NUMBER STAGNANT OR TOTAL FLIGHT MEAN RESPONSE 
CURRENT TIME (age NE SVD RS 
ALL TRIALS 
1 C 1900 1.568 
2 " 1500 1.411 
3 " 2600 0.966 
4 " 2800 : 1.704 
5 “ 4500 1.113 
6 " 3900 0.947 
7 " 2300 1.415 
ae " 6000 1.003 
9 " | 1800 1.693 
10 " 4000 1.112 
11 | " 1600 Perl? 
12 g 1000 1.569 
13 " 1050 1.323 
14 " 1200 1.993 
15 u 2150 1.246 
16. w 750 1.173 
17 , " 1100 1.598 
18 " 3600 1.397 
19 1000 1.023 
20 " 1000 1.789 
21 " 1300 2.070 
22 " 900 1.641 
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APPENDIX B 


All Subjects' Mean Performance by Trials 
ORDINATE: Seconds ABSCISSA: Trial Number 


6 
Z 
Mean of All 
Slides 
1h 
aN Z 3 4 5 
2 
If 
Slidel g 
if 2 3 4 5 
3 
Slide 2 2 
1 
i 2 3 4 5 
Slide 3 
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Slide 4 ‘ 


a» 


Slide 5 
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Slide 6 2 


Slide 7 
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Slide 8 


Slide 9 





Slide 10 
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Slide 11 


Slide 12 


a 
1 Ms 3 4 5 
3 
2 
il 
1 2 3 4 5 





Mean of 
All Trials 


Trial One 


APPENDIX C 


All Subjects' Mean Performance by Slides 
ORDINATE: Seconds ABSCISSA: Slide Number 
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APPENDIX D 


INSTRUCTIONS TO SUBJECTS 


This is an experiment to attempt to determine if a prolonged period 
of no flying is detrimental to one of the basic piloting skills: The 
ability to recover an aircraft from an unusual attitude. 

You will be shown a random sequence of slides of an attitude gyro 
depicting an aircraft in various attitudes. You should respond to the 
slides with the correct initial control input to recover an aircraft 
from that attitude. Please use standard instrument RAG procedures: 

1. If nose high; lower nose then level wings 

2. If nose low; level wings then raise nose 
Assume you have about 250 knots indicated airspeed. (Any questions were 
discussed here.) 

Unfortunately, there is no feedback to a wrong response. If you 
make a wrong response and do not correct it: yourself, I will say "that's 
not right'’. Please make the correct response as soon as you realize what 
it should be. If you have not made the correct response by the time the 
slide goes off (about 8 seconds), I will describe what the situation was 
and what the response should have been. 

To éstablish a basic movement time, I will ask you to move the 
stick five sina in each direction in response to a series of 'neutral" 
slides (it happens to have a '5' on it). These twenty trials will also 
let you get the feel of the stick and of the sequencing of the test. I 
will tell you which direction to move the stick prior to each slide 
during this portion of the test. 

When you move the stick, move it like you would in an aircraft, try 


to resist the temptation to "slap" the stick in reaction to the slides. 
P Pp 


Sil 





After this basic movement time portion there will be five more 
slides that require no specific response. This time can be used to 
clear up any last minute questions you may have before the sequence 
of VGI slides begins. 

Now, before the test begins, you will be shown a slide of the VGI 
in normal flight. Study it, noting its peculiarities, as long as you 


like. Tell me when you have seen it enough. 
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APPENDIX E 


Sequence of Slides Used in Test 


trial set 1 trial set 2 trial set 3 trial set 4 trial set 5 
8 7 i a 2 
3 7 7 3 10 

10 4 8 5 5 
7 1 diz 10 7 
6 6 Z 6 6 

11 8 4 4 3 
5 3 6 2) 2) 
2 5 5 8 4 
2 10 10 Z 8 
4 12 9 11 ib 

12 9 dt JL shik 
AL 11 3 7 al 
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